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(57) Abstract 

A sound recognizer uses a feature 
value normalization process to substantially 
increase the accuracy of recognizing acous- 
tic signals in noise. The sound recognizer o> 
includes a feature vector device (1 10) which 
determines a number of feature values for a 
number of analysis frames, a m in/max device 
(1 20) which determines a minimum and max- 
imum feature value for each of a number of 
frequency bands, a nonnalizer (130) which 
normalizes each of the feature values with 
the mmimum and maximum feature values 
resulting in normalized feature vectors, and 
a comparator (140) which compares the nor- 
malized feature vectors with template feature 
vectors to identify one of the template feature * 
vectors that most resembles the normalized 
feature vectors, 
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METHOD AND RECOGNIZER FOR RECOGNIZING A 
SAMPLED SOUND SIGNAL IN NOISE 

5 Field of the Invention 

The present invention relates, in general, to sound 
recognition, and in particular, to sound recognition in a high or 
variable noise environment. 

10 

Background of the Invention 

Advancing technology is moving steadily towards 
commercializing sound recognition by electronic devices such as 

1 5 speech recognizers. Generally there are two types of speech 

recognizers. One performs certain operations when the user 
gives short commands. A second type accepts dictated speech 
and enters the speech as text. 

Most speech recognizers must be trained by the user 

2 0 before they can recognize words or phrases spoken by the user. 

These are termed "speaker dependent 11 speech recognizers, 
meaning that the speech recognizer must be trained by the 
user's voice before the recognizer can interpret user words and 
commands. Training a speech recognizer requires a user to 
25 speak certain words or phrases into the recognizer, usually 
many times, so that the speech recognizer can recognize the 
user's speech pattern. Later when the user is using the speech 
recognizer, the speech recognizer will compare the input voice 
signal with various stored speech templates to find a template 

3 0 that most resembles the input voice signal. This method is 

called "pattern matching". 

A user will generally "train" a speech recognizer in an 
environment that has relatively low interfering noise. 
Subsequently, most speech recognizers must be used in 
3 5 environments of low interfering noise. Otherwise, the speech 
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recognizer will not be able to separate spoken words from 
background noise. Where speech recognizers are used in low 
noise environments, a fairly high rate of recognition is 
achieved. If the speech recognizer is trained in a location 
5 having a moderate, constant background noise, and 

subsequently used in an environment that has the same 
moderate, constant background noise, a high recognition rate is 
achieved. However, when these speech recognizers are used in 
high noise environments with negative signal-to-noise ratios 
1 0 and environments where the noise present is different than the 
background noise present in the training session, the 
recognition rate falls to very low, unusable accuracy levels. 

To correct the problem of background noise, conventional 
speech recognizers attempt to estimate the characteristics of 
1 5 the surrounding noise and then determine the effects on the 
user's voice. Various techniques are incorporated to build 
statistical or parametric models of the noise which are 
subtracted from the sound signal. In high and variable noise 
environments, these models are very inaccurate. 



20 



Brief Description of the Drawings 



PIG. 1 is a block diagram of a voice recognizer according 
to a preferred embodiment of the present invention. 
25 FIG. 2 shows a flow diagram of a preferred embodiment 

of the present invention. 

PIG. 3 shows a flow diagram of a method used to calculate 
feature values according to a preferred embodiment of the 
present invention. 
3 0 FIG. 4 is a representation of a power spectrum of a 

sampled sound signal with frequency filters imposed thereon 
according to the present invention. 

FIG. 5 shows a matrix of features of the sampled sound 
signal according to a preferred embodiment of the present 
3 5 invention. 
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FIG. 6 shows a matrix of normalized features for the 
features of FIG. 3 according to a preferred embodiment of the 
present invention. 

5 Detailed Description of the Invention 

A preferred embodiment of the present invention is used 
in robust voice recognition for sound recognizers. The 
preferred embodiment is well suited for use in cellular phones 

1 0 in automobiles where a user can keep both hands on the 

steering wheel, eyes on the road, and still make a phone call 
even with windows down and the stereo system on loud. 
Unlike conventional speech recognizers having an unusable, 
poor accuracy rate in high and/or variable noise conditions, 

15 sound recognizers designed according to the preferred 

embodiment of the present invention are robust and can obtain 
a very high accuracy rate in environments which have variable 
noise and noise levels greater than the volume of the user's 
speech. 

20 The present invention shall be described hereafter in 

conjunction with the drawings. In particular, the preferred 
embodiment shall be described with reference to FIG. 1 in 
combination with the other figures. 

The present invention may be applied to the recognition 

25 of any acoustic sound. For instance, the acoustic sound may be 
speech, grunting sounds, sounds made by animals, sounds made 
by instruments including percussion instruments, or any other 
type of sound. Most commonly, the present invention relates to 
recognition of speech. 

3 0 FIG. 1 shows a sound recognizer 100 according to a 

preferred embodiment of the present invention. In the 
preferred embodiment, an acoustic signal is input to an analog 
to digital converter (ADC) 105 of sound recognizer 100 where 
the signal is converted to a digital signal and sampled at a rate 



3 



WO 97/33273 



PCT/US97/04350 



of 16KHz. Other sampling rates may be used as appropriate, 
such as 8KHz. 

The sampled digital signals are input to feature vector 
device 110 which divides the sampled digital signals into 
5 analysis frames. Each analysis frame can be chosen to be either 
of fixed time width (such as 20ms) or may be of varied time 
width depending upon signal characteristics such as pitch 
periods or other determining factors. The starting point of each 
analysis frame can be chosen to be either before, at, or after 
10 the end point of the previous frame. In the preferred 

embodiment, the analysis frames are chosen to be of fixed time 
width, and each analysis frame starts at the ending point of the 
previous analysis frame. 

For each of the analysis frames, feature vector device 110 

1 5 computes a feature vector (210 of the flow chart of FIG. 2). For 

any given number of analysis frames, feature vector device 
110 generates an equal number of feature vectors. A feature 
vector is a series of values, or plurality of feature values, which 
are derived from the sampled sound signal within a given 
20 analysis frame. These feature values are representative of the 
information contained in the sampled sound signal. 

There are many techniques known to those skilled in the 
art of speech recognition which may be used to determine 
feature vectors. The techniques include Linear Predictive 

2 5 Coding (LPC) Coefficients, Cepstral Coefficients, Log Area Ratios. 

and Mel Scale Filterbank Coefficients. The preferred 
embodiment of the present invention utilizes the Mel Scale 
Filterbank Coefficients method, although the present invention 
will operate with other feature vector techniques, such as those 

3 0 listed above, 

Mel Scale Filterbank Coefficients are computed in the 
following manner with reference to the flow chart of FIG. 3. 

1. The sound signal samples for an analysis frame are 
3 5 passed through a high frequency pre-emphasizing filter to 
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whiten the spectrum of the sound signal samples (310 of the 
flow chart of FIG. 3). This increases the relative energy in the 
high frequency components as compared to the energy of the 
low frequency components. Benefits are obtained when the 
5 preferred embodiment of the present invention is used with 
speech signals since low frequency components of speech have 
a relative energy greater than high frequency components and 
the two components are re-balanced in the pre-emphasizing 
filter. In the preferred embodiment, the filtering is 
1 0 accomplished according to the equation: 

Pi (k) = Si(k) - Si(k-l) 
where Si(k) is the sound signal sample at position k in analysis 
frame "i", Si(k-l) is the sound signal sample in analysis frame 
"i" at the previous position in time "k-l M , and pi(k) is the pre- 

1 5 emphasized sound signal sample at position lf k n in analysis 

frame "i". One skilled in the art of speech recognition will 
recognize that other pre-emphasis filters may be used. 

2. The pre-emphasized sound signal samples for each 
20 analysis frame are bandpass filtered by a series of filters 

covering different frequency bands. The filters may be applied 
in any computational manner desired in either the time domain 
or the frequency domain. In the preferred embodiment, the 
filters are applied in the frequency domain. First, however, a 

2 5 power spectrum of the pre-emphasized sound signal samples 

in the analysis frames must be computed (320 of FIG. 3). The 
power spectrum is found by: 

a. The pre-emphasized sound signal samples in the 
analysis frame are multiplied by samples of a window function, 

3 0 or weighting function. Any window function may be applied. 

For purposes of explaining the present invention, a simple 
rectangular window is assumed (the window has a value of 1.0 
for all samples). 
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b. The Fourier Transform of the pre-emphasized 
sound signal samples in each windowed analysis frame is 
computed. 

c. Values for the power spectrum are obtained by 
5 squaring the Fourier Transform values. 

After the values for the power spectrum are determined, 
the band-pass filters are applied in the frequency domain by a 
filter weighting value for each of the power spectrum values 

10 (330 of FIG. 3). Although many filter weighting functions may 
be used within the band-pass filters, the preferred 
embodiment incorporates a raised cosine weighting profile 
which can be seen in FIG. 4. 

FIG. 4 shows a power spectrum 400 having the raised 

15 cosine profile 410 imposed thereon. The frequency bands for 
each band-pass filter, or raised cosine profile 410, in the 
preferred embodiment of the present invention are laid out 
along the frequency axis according to a Mel or Bark scale which 
approximates the frequency response of the human ear. The 

20 frequency bands for the band-pass filters (raised cosine 

profiles 410) are approximately linearly spaced from 0 to lKHz, 
and logrithmically spaced above lKHz. Filter spacings other 
than those defined for the preferred embodiment may also be 
used. As seen in FIG. 4 for the preferred embodiment, the 

25 band-pass filters, or raised cosine profiles 410, overlap. The 
outputs for the band-pass filters, or raised cosine profiles 410, 
are computed according to: 

fij-2Pi(cD)Bj(co) 
where Pi(w) is the powe spectrum value for analysis frame "i" 

3 0 at frequency o>, Bj(o>) is the band-pass filter weighting function, 
or frequency response for filter "j" at frequency w, E represents 
the summation operation over all frequencies w, and fy is the 
band-pass filter output for analysis frame "i" and band-pass 
filter "j". 
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After all the band-pass filter outputs for each analysis 
frame "i" (OS i< n) and each band-pass filter "j" (OS j £ m) 
have been calculated, feature vector device 110 calculates 
feature values %" of tne sampled sound signal by taking the 

5 log of each band-pass filter f 5J (340 of FIG. 3). The result may 
be shown as a matrix such as the one illustrated in FIG. 5 
structured with "i" analysis frames and "j" band-pass filters 
having a dimension of n x m. All of the feature values within 
an analysis frame, v» through v im , form a single feature vector 

10 (as in vi i through vij, item 510), and all analysis frames, 0 < i 
< n, form a plurality of feature vectors for the sampled sound 
signal. 

Once the plurality of feature vectors for analysis frames 
"i" - 1 through "n" have been computed, a min/max device 120 
15 (FIG. 1) coupled to or incorporated within feature vector device 
110 reviews all of the feature values within a frequency band 
for band-pass filter "j" and finds the minimum (minj) feature 
value and the maximum (maxj) feature value for frequency 
band "j" for all analysis frames, 0 < i < n (220 of FIG. 2). These 
20 minimum and maximum values are used to determine 
normalized feature values, "v~". 

Normalizer 130 of FIG. 1 is coupled to min/max device 
120 and feature vector device 110. Normalizer 130 normalizes 
each of the feature values across a frequency band, or band- 
25 pass filter, "j". with the minimum and maximum feature values 
for that band-pass filter to determine the normalized feature 
values "v~" (230 of FIG. 2). The normalization equation is: 

v~ij = ( Vy - minj )/ ( maxj - minj ) 
where v~y is one of the normalized feature values, Vjj is one of 
3 0 the feature values, minj is the minimum feature value for the 
"jth» frequency band, and maxj is the maximum feature value 
for the "j*" frequency band. 

In an improved alternative embodiment, the min/max 
device 120 finds a weighted minimum (minj) feature value and 
3 5 a weighted maximum (maxj) feature value for frequency band 
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»j" for all analysis frames, 0 < i < n (220 of FIG. 2). These 
minimum and maximum values are computed as follows: 

wminj = Xweight[K]min[j+k] 



k--r 
r 



wmaxj - tweight[K]max[j+k] 
k— r 

5 where r is ususally a small value such as 2 or 3, weight[k] is 
typically a weighting function where the central point, 
weight[0], has a value greater than or equal to all other weight 
values and 

£weight[K] - 1.0. 

10 These weighted minimum and weighted maximum values are 
used to determine the normalized feature values, "v~". In this 
embodiment the normalization equation is: 

V-jj - ( Vij - Wminj )/ ( Wmaxj " Wminj ) 
where, o minj is the weighted minimum feature value for the 
15 "jth" frequency band, and o> ma xj is the weighted maximum 
feature value for the 7 h " frequency band. 

The result of the normalization process can be shown as a 
matrix as illustrated in FIG. 6. Each of the analysis frames V of 
FIG 6 represents a normalized feature vector (610). 
20 Comparator 140 of FIG. 1 is coupled to normalizer 130 

and compares the normalized feature vectors with template 
feature vectors to determine which of the template feature 
vectors most resembles the normalized feature vectors. Sets of 
template feature vectors representing phrases or commands 
25 are stored within template feature vector library 150. 

Comparator 140 compares the normalized feature vectors from 
normalizer 130 with each of the template feature vectors in 
template feature vector library 150 in turn (240 of FIG. 2) and 
determines which set of the template feature vectors most 
3 0 resembles the normalized feature vectors (250). This is done 
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by computing a distance metric between the normalized 
feature vectors and each of the sets of template feature vectors. 
The set of template feature vectors having the minimum 
distance metric is determined to be the one which most 
5 resembles the normalized feature vectors. Comparator 140 of 
FIG. 1 outputs as a best-fit match the set of template feature 
vectors from template feature vector library 150 which most 
resembles (has the minimum distance metric) the normalized 
feature vectors (250 of FIG. 2). 

1 0 There are several well known methods whereby the 

plurality of normalized feature vectors may be compared with 
the template feature vectors to find a best-fit match. Studies 
using the preferred embodiment of the present invention show 
that comparing the plurality of normalized feature vectors with 

1 5 the template feature vectors in a dynamic time warping 
process yields the best results. 

As mentioned earlier, the present invention when used in 
a speaker dependent, small vocabulary sound recognition 
system is very robust and increases recognition accuracy in 

20 high and variable noise environments from unusable accuracy 
rates to very high accuracy rates. 

It should be recognized that the present invention may 
be used in many different sound recognition systems. All such 
varied uses are contemplated by the present invention. 
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What is claimed is: 
CLAIMS: 

5 1. A method comprising the steps of: 

computing feature values for a number of analysis 
frames of an acoustic signal, the feature values computed over 
a plurality of frequency bands; 

for each of the plurality of frequency bands, 
1 0 determining which of the feature values within a respective 
one of the plurality of frequency bands is a minimum feature 
value and which of the feature values within the respective one 
of the plurality of frequency bands is a maximum feature 
value; 

1 5 comparing each of the feature values within each of 

the plurality of frequency bands with the minimum feature 
value and the maximum feature value of the respective one of 
the plurality of frequency bands to obtain normalized feature 
values, wherein all of the normalized feature values for a given 
20 one of the number of analysis frames defines one of a plurality 
of normalized feature vectors; 

comparing the plurality of normalized feature 
vectors with sets of template feature vectors to determine 
template feature vectors that most resemble the plurality of 

2 5 normalized feature vectors; and 

outputting the template feature vectors that most 
resemble the plurality of normalized feature vectors. 



10 



WO 97/33273 



PCT/US97/04350 



2, A method according to claim 1 wherein the step of 
determining which of the feature values within a respective 
one of the plurality of frequency bands is a minimum feature 
value and which of the feature values within the respective one 
5 of the plurality of frequency bands is a maximum feature value 
comprises finding a weighted minimum feature value and a 
weighted maximum feature value for each of the plurality of 
frequency bands. 

10 3. A method according to claim 1 wherein the step of 

computing feature values comprises: 

dividing a power spectrum of the acoustic sound 
signal into the plurality of frequency bands; 

weighting the power spectrum within each of the 

1 5 plurality of frequency bands according to a weighting function 

to obtain filter outputs; and 

calculating the feature values from the filter 

outputs. 

20 4. A method according to claim 3 wherein the power 

spectrum is weighted in a frequency domain according to a 
raised cosine profile. 

5. A method according to claim 4 wherein the raised 

2 5 cosine profile calculates the filter outputs according to an 

equation: 

fy - 1 Pi(G))Bj(co) 
where fy is one of the filter outputs at an analysis frame "i M of 
the number of analysis frames and a frequency band "j M of the 
30 plurality of frequency bands, Pj(G)) is a power spectrum value 
for the analysis frame "i" at frequency co, Bj(co) is a band-pass 
filter weighting function, or frequency response, for the 
frequency band "j" at frequency to, and Z represents a 
summation operation over all frequencies o>. 

35 
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6. A method according to claim 1 wherein the step of 
comparing the normalized feature vectors with sets of template 
feature vectors to determine the template feature vectors that 
most resemble the normalized feature vectors includes 

5 comparing the normalized feature vectors with the sets of 
template feature vectors in a dynamic time warping process. 

7. A method according to claim 3 wherein the step of 
calculating the feature values from the filter outputs comprises 

1 0 taking a log of each of the filter outputs. 

8. A method according to claim 3 wherein the power 
spectrum is divided into the plurality of frequency bands 
according to a Mel or Bark scale to approximate a frequency 

1 5 response of a human ear. 

9. A method according to claim 1 wherein each of the 
normalized feature vectors is found according to an equation: 

v~y - ( Vij - minj )/ ( maxj - minj ) 

2 0 where v~ij is one of the normalized feature values 

of an analysis frame "i" of the number of analysis frames and a 
frequency bands at "j" of the plurality of frequency bands; 

Vjj is one of the feature values at the analysis frame 
,f i" and the frequency band "j"; 
2 5 minj is the minimum feature value for the "j" 

frequency band; and 

maxj is the maximum feature value for the "j" 
frequency band. 
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10. A sound recognizer comprising: 

a feature vector device which computes feature 
values for a number of analysis frames of an acoustic signal 
input to the sound recognizer, the feature values computed for 
5 a plurality of frequency bands; 

a min/max device coupled to the feature vector 
device to determine which of the feature values within a 
respective one of the plurality of frequency bands is a 
minimum feature value and which of the feature values within 
1 0 the respective one of the plurality of frequency bands is a 

maximum feature value for each of the plurality of frequency 
bands across all the number of analysis frames; 

a normalizer coupled to the min/max device which 
compares each of the feature values within each of the 
1 5 plurality of frequency bands with the minimum feature value 
and the maximum feature value of the respective one of the 
plurality of frequency bands to obtain normalized feature 
values, wherein all of the normalized feature values for a given 
one of the analysis frames defines one of a plurality of 
20 normalized feature vectors; and 

a comparator coupled to the normalizer which 
compares the plurality of normalized feature vectors with sets 
of template feature vectors to determine template feature 
vectors that most resemble the plurality of normalized feature 
25 vectors, the comparator outputting the template feature vectors 
that most resemble the plurality of normalized feature vectors. 
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11. A sound recognizer according to claim 10 wherein the 
normalizer computes each of the plurality of normalized 
feature vectors according to the equation: 

v-jj ■= ( vjj - minj )/ ( maxj - minj ) 

where v~ij is one of the normalized feature values 
of an analysis frame "i" of the number of analysis frames and a 
frequency bands at "j" of the plurality of frequency bands; 

is one of the feature values at the analysis frame 
"i" and the frequency band "j"; 

minj is the minimum feature value for the "j" 

frequency band; and 

maxj is the maximum feature value for the "j" 

frequency band. 

12. A sound recognizer according to claim 10 wherein the 
comparator is coupled to a template feature vector library, the 
template feature vector library containing the sets of template 
feature vectors. 
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